The Mechanical Turk: Enduring Misapprehensions Concerning Artificial Intelligence
نویسندگان
چکیده
منابع مشابه
Crowdsourcing Transcription Beyond Mechanical Turk
While much work has studied crowdsourced transcription via Amazon’s Mechanical Turk, we are not familiar with any prior cross-platform analysis of crowdsourcing service providers for transcription. We present a qualitative and quantitative analysis of eight such providers: 1888-Type-It-Up, 3Play Media, Transcription Hub, CastingWords, Rev, TranscribeMe, Quicktate, and SpeakerText. We also provi...
متن کاملThe Language Demographics of Amazon Mechanical Turk
We present a large scale study of the languages spoken by bilingual workers on Mechanical Turk (MTurk). We establish a methodology for determining the language skills of anonymous crowd workers that is more robust than simple surveying. We validate workers’ selfreported language skill claims by measuring their ability to correctly translate words, and by geolocating workers to see if they resid...
متن کاملThe (Statistical) Power of Mechanical Turk
In this paper, I argue for the use of Amazon Mechanical Turk (AMT) in language research. AMT is an online marketplace of paid workers who may be used as subjects, which can greatly increase the statistical power of studies quickly and with minimal funding. I will show that—despite some obvious limitations of using distant subjects—properly designed experiments completed on AMT are trustworthy, ...
متن کاملExploring Repeatability on Mechanical Turk
Crowdsourcing is gaining attention from companies looking for a low-cost, scalable labor force as well as from researchers seeking to leverage human intelligence and study human cognition. Much current crowdsourcing research is related to discovering methods for obtaining high-quality, trustworthy output from the crowd. One element of quality crowd-generated work is repeatability; ie, results a...
متن کاملArtificial Intelligence for Artificial Artificial Intelligence
Crowdsourcing platforms such as Amazon Mechanical Turk have become popular for a wide variety of human intelligence tasks; however, quality control continues to be a significant challenge. Recently, we propose TURKONTROL, a theoretical model based on POMDPs to optimize iterative, crowdsourced workflows. However, they neither describe how to learn the model parameters, nor show its effectiveness...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: The Cambridge Quarterly
سال: 2017
ISSN: 0008-199X,1471-6836
DOI: 10.1093/camqtly/bfx005